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STATIONARY  MARKOV  SETS 

M.  I.  Taksar* 

Department  of  Statistics 
Florida  State  University 
Tallahassee,  Florida 
United  States 

1.  Introduction 

If  one  looks  at  the  set  of  times  when  a  strong  Markov  process  visits  a  point 
in  the  state  space,  then  this  set  is  a  regenerative  set.  It  forms  a  replica  of 
itself  after  each  stopping  time  whose  graph  lies  in  this  set.  Closed  regenerative 
sets  have  been  studied  for  a  long  time  (see  Hoffman -Jurgen sen  [4],  Maisonneuve 
[8],  Meyer  [9]  and  others). 

Since  the  studies  of  regenerative  sets  were  motivated  by  the  theory  of  Markov 
processes,  such  sets  were  originally  called  (strong)  Markov.  In  addition  it  was 
always  supposed  that  any  regenerative  set  M  is  a  subset  of  the  positive  half-line 
and  P { 0 e  M)  =  1. 


„* W'?  v  • 


However,  if  one  considers  visiting  times  of  a  stationary  strong  Markov  pro¬ 
cess,  then  the  corresponding  set  M  is  stationary,  that  is  the  probability  law  of 
the  set  M  +  t  is  the  same  as  the  one  of  M„  The  "natural"  state  space  for  station¬ 
ary  sets  would  be  the  set  of  closed  subsets  of  a  real  line  and  the  condition 
Os  M  a.s.  should  be  dropped.  The  first  study  of  such  sets  was  done  in  Taksar 
[11].  It  was  shown  that  all  such  sets  are  in  one-to-one  correspondence  with  the. 
ranges  (closures  of  the  images)  of  the  processes  with  independent  increments 
having  finite  expectation. 


*)  This  research  was  supported  by  the  AFOSR,  Grant  No.  AFOSR  F49620-8S-C-0007 . 
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The  paper  of  Maisonneuve  [8]  gives  a  simple  and  comprehensive  approach  to 
the  regenerative  sets  on  a  real  line.  It  also  gives  an  easy  proof  of  the  main 
results  of  [11].  Further  development  of  the  theory  of  regenerative  sets  on  a 
real  line  is  done  in  the  recent  work  of  Fitzsimmons,  Frisdedt  and  Maisonneuve  [3]. 

All  regenerative  sets  have  a  (weak)  Markov  property.  The  "future"  after 
time  t  of  such  set  and  its  "past"  are  conditionally  independent  given  "present". 

A  Markov  set  is  the  set  for  which  conditional  independence  of  the  "future"  and 
the  "past"  holds,  but  stronger  regenerative  property  might  not  be  true. 

Apparently,  Markov  sets  form  a  larger  class  than  regenerative  sets.  In  a 
stationary  case,  however,  the  difference  is  not  as  big  as  one  could  expect.  It 

was  shown  in  [11]  that stat ionary  Markov  sets  are  "almost"  regenerative.  There  are 
two  types  of  regeneration  after  each  point  t;  one  occurs  if  the  point  t  belongs 
to  the  set  and  the  other  type  of  regeneration  takes  place  if  t  does  not  belong  to 
the  set.  In  particular,  every  stationary  Markov  set  which  almost  surely  has 
Lebesgue  measure  zero,  is  regenerative,  (see  [11]  Theorem  2). 

In  this  paper  we  will  describe  all  closed  stationary  Markov  sets.  We  will 
show  that  each  stationary  Markov  set  which  is  not  regenerative  can  be  constructed 
from  two  special  regenerat ive  sets,  by  either  taking  a  mixture  of  these  regenera¬ 
tive  sets  or  taking  a  "superposition"  of  two  regenerative  sets.  Superposition  can 
be  described  loosely  as  cutting  two  real  lines  IRj  and  IR2  with  two  sets  Mj  and  M?  in 
them,  into  pieces  of  iid  length  and  then  combine  them  into  one  line  alternating  pieces 
from  IR^  andlR-,.  The  union  of  the  cut  offs  from  Mj  and  M2  will  be  the  superposition 
of  the  sets  Mj  and  M-,. 

The  paper  is  structured  as  follows.  In  section  2  w:e  give  definitions  and 
formulate  the  main  results.  In  section  3  we  establish  the  main  properties  of 
stationary  Markov  sets.  Section  4  studies  the  operation  which  transforms  a 
stationary  Markov  set  into  a  stationary  regenerative  set.  Section  5  analyses 
those  stationary  Markov  sets  which  are  neither  regenerative  nor  are  mixtures  of 
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regenerative  sets.  In  section  6  we  study  the  "residual  life"  process  associated 
with  the  stationary  Markov  set,  and  find  its  stationary  distribution.  The  last 
section  is  devoted  to  reversability  properties.  We  outline  a  necessary  and  suffi¬ 
cient  condition  for  the  set  -M  to  have  the  same  distribution  as  M. 

2.  Basic  definition.  Formulation  of  the  main  result. 

In  our  definition  and  notations  we  follow  Maisonneuve  [8]  and  Fitzimmons, 
Fristedt,  and  Maisonneuve  [3],  Let  be  the  set  of  all  closed  sets  in  1R.  For 
each  c  0°  and  t  e  1R  put  (assuming  inf  0  =  ■  ,  sup  0  =  --• ) 

dt(u°)  =  inf(s>t:  sew0),  £t(w°)  =  sup{u<t:  uew0} 

rt(u>°)  «  dt(u)°)  -  t,  nt(co°)  =  t-£t(u0) 

Tt(u)°)  =  {s-t:  s^t,  sew0} 
c  (<*>°)  =  (s-t:  s<t  sea:0 } 

Let  G°  (P°  respectively)  be  the  o-field  generated  by  all  functions  ds,  se  F 
(s <  t  respectively).  Let  J°  (J°  respectively)  be  the  o-field  generated  by  all 
functions  ue  1R  (u  >  t  respectively).  It  is  easy  to  see  that  G°  is  an  increasing 
and  J°  is  a  decreasing  filtration  and  J°  =  G° . 

A  closed  random  set  M  on  a  space  (ft,F)  is  a  measurable  mapping  of  (ft,F)  into 

(n°,G°). 

In  this  paper  we  will  deal  only  with  closed  random  sets,  so  in  the  sequel  we 
will  not  write  "closed"  each  time.  Put 

n  *dteM,  Rt=rt°M 

L  =  lt  °  M,  Nt  =  nt  o  M 

M1  =  xn  °  M,  M  =  f*.  0  M 
t  *  t 

It  is  obvious  that  all  the  mappings  D^,  R^,  L^  and  are  measurable  and  so  are 
Mt  and  M  . 
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Let  (n,F,P)  be  a  complete  probability  space  and  M  be  a  random  set  on  this 
space.  Let  G,  Gt  and  J  be  the  preimages  in  F  of  the  o-fields  G°,  G°  and  J° 
under  the  mapping  M. 

(2.1)  A  set  M  is  called  right  Markov  (r.M.)  if  for  any  two  bounded  measurable 

functions  f  and  g  on  (S7°,G0) 

P{f  (Mn[t ,“[) g(Mn]-“,t] |  D^}=P{f  (Mn[t ,®[)  |  Dt}P{g(Mn]-»ft])  |  Dt). 

(2.2)  A  set  M  is  called  left  Markov  (l.M.)  if  for  any  two  bounded  measurable  function 
f  and  £  on  (ft°,G°) 

P{ f  (Mn[t  ,°°C)  g(Mn]-“>, t)  1 >  =  P(f  (Mn[t ,“[)  |  Lt>  P{g(Mn]-»,t  ])  |  Lt } . 

For  brevity  here  and  in  sequel  we  write  equations  with  conditional  expectations 
without  adding  a.s.  after  equalities.  Given  a  random  set  M,  we  denote  by  M+s 
the  set  { t+s  :  t  f  M) . 

(2.3)  A  set  M  is  called  stationary  if  for  any  bounded  measurable  function  f  on 
(ft0  ,G°)  and  any  se  IR 

P{f (M+s) }  =  P{f (M) } . 

Our  aim  is  to  describe  all  stationary  r.M.  sets.  We  will  need  results  from 
the  theory  of  regenerative  sets.  The  precise  notion  of  regenerative  set  used  in 
this  paper  is  due  to  Maisonneuve  [S]. 

(2.4)  A  random  set  M  is  right  regenerative  (r.c)  if  there  exists  a  measure 

Pq  on  (ft°,G°)  such  that  for  each  f «  bG°  (set  of  bounded  G° -measure able  functions) 

P{f-  Mt|Gt)  =  PQ{f}  on  { Li  <  »}. 

Following  [8],  the  measure  P^  is  called  the  law  of  (right)  regeneration  of  M. 

(2.5)  A  set  M  is  left  regenerative  (i.r.)  if  there  exists  a  measure  P^'  on  (ft°,G°) 
such  that  for  each  f  e  bG° 

P(f o  Mt|Jt)  =  P°{f)  on  (Lt >  -«). 
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In  the  sequel  for  brevity,  we  will  use  the  term  regenerative  (r.)  and  Markov  (M} 
instead  of  right  regenerative  and  right  Markov  respectively. 


Increasing  processes  with  independent  increments  (subordinators)  play  an  impor¬ 
tant  role  in  the  description  of  regenerative  sets  and,  as  we  will  see  in  the  sequel, 
stationary  Markov  sets  as  well.  Each  subordinator  z  is  characterized  by  a  constant 
a  <  0  and  a  measure  IT  on  ]  0,“[.  We  call  such  a  subordinator  an  (a,p  ) -process. 

Let  z^ (co)  ,  t^O,  be  a  stochastic  process  on  a  probability  space  (ft,F,P).  The 
image  M  of  this  process  is  defined  as 

MM  =  z'R'U 

+ 

where  bar  above  the  set  stands  for  closure.  If  z  is  a  subordinator,  then  the 
image  of  z  is  a  right  regenerative  set.  If  z  is  a  decreasing  process  with  inde¬ 
pendent  increments  then  the  image  of  z  is  a  left  regenerative  set. 

Let  us  recall  the  main  results  of  [8]  and  [11]  regarding  stationary  regener¬ 
ative  sets.  There  is  one-to-one  correspondence  between  all  stationary  r.r.  sets 
M  and  all  pairs  (a,  JT)  defined  up  to  proportionality,  where  a  and  II  are  charac¬ 
teristics  of  a  subordinator  subject  to 

oo 

/  x  II  (dx)  <  <*  . 

0 

The  stationary  set  M  which  corresponds  to  the  pair  (a,  II)  is  called  [a,  II ) -generated 
Any  stationary  r.r.  set  M  is  also  l.r.  Moreover  the  set  -M  has  the  same  distri¬ 
bution  in  (fi°,G°)  as  M. 

Since  the  definition  of  r.M.  set  is  weaker  than  that  of  r.r.  set,  any  r.r. 
set  is  r.M.,  however  the  opposite  is  not  true. 

An  example  of  a  stationary  r.M.  set  which  is  not  r.r.  was  constructed  in 


[11].  Any  mixture  a  (0,  II) -generated  set  and  a  real  line  IR  with  "weights" 
0  <  p  <  1  and  q  =  1  -  p  is  a  r.  M.  set  but  not  a  r. r.  set. 
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DEFINITION.  Right  Markov  sets  of  the  first  type  are  right  regenerative  sets. 

Right  Markov  sets  which  can  be  represented  as  a  mixture  of  a  (0,  n) -generated  and 
a  real  line  are  called  r.M.  sets  of  the  second  type.  Right  Markov  sets  which  are 
neither  of  the  first  or  the  second  type  are  called  right  Markov  sets  of  the  third 
type . 

Markov  processes  provide  good  examples  of  different  types  of  stationary 
Markov  sets.  If  is  a  strong  Markov  process  and  b  is  a  point  in  the  state  space 
then  the  "visiting  set" 

M  =  { t :  x^.  =  b } 


is  regenerative  and  if  in  addition  xt  is  stationary,  then  M  is  stationary. 


.1 


To  obtain  a  Markov  set  of  the  second  type,  consider  a  strong  Markov  process  xi 

for  which  P{xj.  =  b)  =  0  for  each  t,  but  point  b  is  not  a  polar  set  and  a 
o 

process  x~  which  stays  deterministically  at  the  point  b.  The  mixture  xt  of  the 
1  2 

processes  xt  and  xt  will  be  a  Markov  (but  not  a  strong  Markov)  process.  The 
visiting  times  of  b  by  xt  is  a  Markov  set  of  the  second  type,  and  if  x}  is  sta- 

L 

tionary  then  so  is  the  visiting  times  set. 

To  give  an  example  of  a  Markov  set  of  the  third  type,  consider  a  particle 
moving  on  the  positive  half  line  according  to  a  diffusion  law.  An  infinitely  thin 
elastic  screen  is  placed  at  the  origin.  The  particle  is  reflected  from  this  screen 
un  t i 1  time 

t  =  {inf  t :  /.  >  S } 

where  is  the  local  time  at  zero  of  the  reflected  diffusion  and  S  is  a  random 
variable  with  exponential  distribution  independent  of  the  process  xf .  At  the 
moment  t  the  particle  moves  to  the  other  side  of  the  screen  where  it  stars  for 
time  X,  where  X  is  another  exponential  random  variable  independent  of  x.  and  S. 

At  the  time  X+  t  the  partical  is  placed  back  to  a  random  point  on  the  positive 
half  line  and  the  whole  process  starts  anew.  The  closure  of  the  set  of  times  when 
this  particle  visits  the  origin  is  a  Markov  set  of  the  third  type.  If  this  Markov 
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process  is  stationary  (which  can  be  easily  achieved,  provided  that  there  exists  a 
constant  downward  drift,  or  there  exists  a  reflecting  upper  barrier) then  this 
Markov  set  is  stationary. 

In  the  remainder  of  this  section  we  define  rigorously  the  superposition  of 
two  regenerative  sets  and  formulate  the  main  result. 

Let  IT  be  a  measure  on  and  y  be  a  probability  measure  on  [0,®[  and  A  and 

a  be  two  positive  constants.  Let  y  be  a  (0,  II)-process  and  {S  },  k  =  l,  2, 

(Xj,)  and  (Yk },  k  =  0,  1,  2,  ...  be  three  sequences  of  iid  random  variables,  indepen¬ 
dent  of  yt  and  independent  of  each  other.  The  distributions  of  S.  and  X,  are 
exponential  with  parameters  a  and  A  respectively.  The  distribution  of  Y.  is  given 
by  y.  Consider  a  subordinator  xt  of  a  pure  iumn  type  constructed  in  the  following 
manner  (we  assume  below  oq =  0) 


°k  '  °k-l  Sk  ’  k  -  1,  2,  . . . 


Xe  "  Xo  “  ^k  +  Xk*  k  =  1  *  2  ’  •  ♦  ■ 

K  K 


cs  =  xu  if  ok<s<u  <  ok+]  ,  k  =  0 ,  1 


(2.6) 


Put 


-t  =  yt  +  xt 


L  =  u  (x:Z  <x?Z  +  X.  } 

k-1  °k  V  k 


M  =  L 


(2.7) 

(2.  S) 


The  set  M  defined  by  (2.8)  is  called  (11  ,a,A,y)-set.  (Mote  that  there  arc  many 
(  11 ,a,  •  ,u) -sets  corresponding  to  different  initial  distributions  of  the  process  v^)  . 

Let  v  ’  be  the  restriction  of  y  on  We  say  that  quadruple  (Tl  ,a,A,y)  is 

equivalent  to  (  ^ ] »aj ,Uj)  if  there  exists  a  constant  c  such  that 


(H  ,  a)  =  c(H  j ,  ap 


y 


y ( 0}  -  y  j { 0} 

n  (RJ 


(2.9) 

(2.10) 
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A(1  -  ay{0}  /(a  +  R  (*«.))  =  X(1  -  OjU^Oj/Ca  +  H  j(R+)) 


(2.11) 


In  particular,  when  R  is  an  infinite  measure,  equivalency  of  (II,ot,A,p)  and 
(  nj.otj  means  proportionality  of  (n,ot)  and  and  equality  of  (A,p) 

and  (A  ,Uj). 

It  is  easy  to  see  that  if  R(lR+)=°°  and  quadruples  (JI>a>x,u)  and  (R^a^Aj.i 
are  equivalent  then  every  (  TT  ,a,  A  ,p) -set  is  a  (  TT^  ,a^  ,  X^  ,p^) -set  as  well.  In  fact, 
if  we  construct  processes  x,  y  and  Z  by  (2,6)  and  (2,7),  then  processes  x^  =  xct> 
y»  =  v  and  =  Z  ^  generate  the  same  set  M  given  by  (2.8).  However,  the  Levi's 
measure  of  the  process  x  ^  is  cR  and  the  rate  of  jumps  of  the  process  y^.  is  c  a, 
which  shows  that  (  JT,a,X,u)-set  is  (cH  ,  c  a,A,p)-set  as  well. 

If  11  is  a  finite  measure  then  both  processes  x  and  v  have  jumps  governed  bv 
Poisson  processes  with  rates  a  and  TT(]R+)  respectively.  In  particular 

p  -  P(y0  =y0>  =  a/(a+  R(1R+)) 

(see  (2.6)  for  definition  of  c^).  The  set  M  given  by  (2.7)  consists  of  the  inter¬ 
vals  <  f  [  and  discrete  points  of  the  image  of  Z.  The  length  of  the  first  interval 
I  c^f  _  i  equal  to  X^  +  X-,  +  . . .  +  X^,  where  N  has  geometric  distribution  with  para¬ 
meter  p •  0 ; ,  Thus  the  distribution  of  Ij  is  exponential  with  parameter  X(l-pu(0}). 
'1  he  di  st  ribut  i  on  of  the  interval  .1  which  is  contingent  to  I  j  in  M 

from  the  right  ( i  -  c . ,  inf-,  t :  t-:.l  j  r  =  sup{  s :  sc  I  j })  has  distribution  y  '*  (;.  { 0  •  /  R  ( 1R+ )  i  R 

(note  that  (  II  (K  ) )  *JT  is  the  distribution  of  the  jumps  of  the  process  v) .  Like¬ 
wise  for  any  other  interval  1^.  in  L  and  contingent  to  1^  interval  Jj..  The  distri¬ 
bution  of  any  interval  contingent  to  M  which  does  not  coincide  with  any  of  is 
equal  to  the  distribution  of  jumps  of  y,  i.e.  to  (R  QR  ))”*R  .  From  the  above  it 
is  easy  to  show  that  if  M  is  a  (  II ,a, X ,p) -set  and  (R  ,a,X,u)  is  equivalent  to 
(R j  ptj , X i  ,yj)  then  there  exists  a  ( R ^ ,a^ , X^ ,y  ) -set  whose  distribution  is  the 


same  as  that  of  M. 


v * v ■  u * u ■  M * 'J  * '.4  L"j  y „ j  ■  v*..  ■■.■  .■ 


DEFINITION.  A  random  set  M  is  called  (II,  a, X, p) -generated  if  for  each  t  there 


exists  a  random  variable  <|>t,  such  that  4>t  >  t  a.s.  and  M  n  C<J>t ,°°C  has  the  same 
distribution  as  a  (H ,  a,X,p)-set.  In  this  case  the  quadruple  (n,a,X,p)  is  called 
the  generator  of  the  set  M. 


The  next  two  theorems  give  the  main  result  of  this  paper, 

(2,12)  THEOREM.  Every  stationary  r.M.  set  M  of  the  third  type  is  (J1  ,a,X,p)- 
generated.  The  generator  of  M  is  unique  up  to  equivalency  and  is  subject  to 

oo 

/  xIT  (dx)  <  00  (2, 15) 

0 

00 

/  x  p(dx)  < “  (2. 14) 

0 

Each  quadruple  (  H  ,  a ,  X ,  p )  subject  to  (2.13)  and  ( 2  . 14)  is  a  generator  of  a  unique 
stationary  right  Markov  set. 

Let  5  denote  a  unit  measure  concentrated  at  point  a. 
a 

(2.15)  THEOREM  A  stationary  r.M.  set  M  of  the  third  type  is  left  Markov  iff 
its  generator  (n,a,X,p)  is  equivalent  to  (H  ,oi,X,6q).  In  this  case  the  set  -M 
h a s  the  s ame  d  i  s  tri but  ion  as  M . 


In  the  diffusion  example  presented  above  the  set  of  visiting  times  of  0 
becomes  a  left  Markov  set  when  the  diffusion  process  is  made  continuous.  That 
can  he  done  if  at  the  time  ■  +  \  the  particle  is  moved  on  the  other  side  of  the 
elastic  screen  and  starts  again  moving  according  to  the  original  reflected  diffu¬ 
sion  law. 


3.  General  properties  of  stationary  Markov  sets. 


Here  and  in  the  sequel  we  will  deal  only  with  those  stationary  Markov  sets 
which  are  a.s.  nonempty.  This  is  equivalent  to 


p{Dt  <  »}  =  1  for  all  t  e  R. 


(3.1) 


The  following  proposition  was  proved  in  [11]  (see  Lemma  7.3). 

(3.2)  PROPOSITION .  If  M  is  stationary  Markov  set  then  for  each  function  fe  bG° 
there  exist  two  constants  a  and  b  such  that  for  each  t 

'"•“V.l  -  bl„t  =  t  • 


For  brevity  we  will  denote  indicator  functions  of  ]-“,t[,  ]-»,t],  [t,°°[, 
]t,®[  by  1  ,  l  ,  l>t  and  l>t  respectively. 

The  following  corollary  is  a  simple  consequence  of  Propostion  (3.2). 


(3.3)  COROLLARY.  J_f  M  is  a  stationary  Markov  set  then  there  exist  two  measures 
P0  and  Pj  on  (fi°,G°)  such  that  for  each  f  e  bG° 

P(f°Mt|Gt}  =  l<t(Dt)P0(f)  +  (3>4) 

Let  M  denote  the  set  of  all  points  of  M  which  belong  to  M  with  its  right 
neighborhood. 

(3.5)  PROPOSITION.  For  each  fe  bG°  and  any  stopping  time  T  w~ith  respect  to  the 
fi It  rat  ion  G 

P{foMT|Gr+)  =  lTc--P0(f}  +  1t(M)  Pj(f)  (5.6) 

Pic Usual  arguments  show  that  Proposition  (3.5)  remains  true  if  t  in 

(3.4)  is  replaced  by  any  stopping  time  with  respect  to  G  ,  taking  finite  or  coun¬ 
table  number  of  values. 


It  is  sufficient  to  prove  (3.6)  for  f  of  the  form 


f  = 


) 


where  g  is  a  bounded  continuous  function  of  k  variables.  For  such  f  the  function 
f  o  M*  is  continuous  in  t  and 


P{foMT|GT+)  =  limP{foMn|G  }  = 
n-*»  n 

(3.7) 

=  lim  [1>T  (D  )P  ( f )  +  1  (D  )P  {f}] 
n-*°°  n  n  n  n  1 


where  is  any  sequence  of  stopping  times,  taking  on  finite  or  countable  number 

of  values  and  such  that  T  4-  T. 

n 

Put 

aeh(x)  =  k  2'n,  if  (k-l)2"n  <  x  <  k  2-n  (3.8) 

and  let  (assuming  inf  0  =  +<*) 

T  J  =  inf  {a?n  (si :  s  -  T ,  u  r  M  for  all  s  <  u  <  a:n  (.s  J  ;  . 


The  random  variable  T^J  is  a  stopping  time  (see  (21,  Ch  VT)  and  so  is 


T 

n 


1,  (Ml  *n(T)  +  1 


T"M 


T' 

n 


(3.9) 


Each  T  given  by  (3.9)  takes  at  most  a  countable  number  of  values  and  +  T.  By  the 

construction  I*  >T  on  the  set  {T  c  M)  and  {T  =  D_  }  converges  to  the  set  (T  e  Ml. 
In  n  T 

n  n 

Hence  we  can  pass  to  a  limit  in  (3.7)  and  obtain  (3.6). 
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1  mta  T  i  '■  -  *  .  '  .y .A-  .  ..A  -  ■r-  - 


%:v:vv 


•r’X-vy; 

• «  *  -  •  .. 


h*. 


(3.10)  PROPOSITION.  For  each  f  e  bG°  and  each  stopping  time  T  with  respect  to 

G\  and  each  i  =  0,  1  , 
wt+  - 

Pi{foXdTlGT+}  =  1Tea5°P0{f}  +  Mfi°)Pl{f}-  (3-U) 

The  proof  is  similar  to  the  proof  of  previous  proposition. 

From  now  on  we  will  consider  only  stationary  sets  of  the  third  type,  for 

which 

P{Dt  =  t}>0.  (3.12) 

(Theorem  2  of  [11]  shows  that  failure  of  (3.12)  implies  that  M  is  regenerative. 


(3.15)  PROPOSITION.  For  each  t 

P{Dt  =  t,  t  e  M)  =  0  .  (5. 14) 


P'XO 0 ^ .  Suppose  the  left  hand  side  of  (3.14)  is  equal  to  e  >  0.  By  virtue  of 
Proposition  (3.5) 


P{foMt|Gt+)  =  PQ{f)  on  {D  =t,  tiM). 

On  the  other  hand,  using  sequentially  (5.4)  and  (5.15) 

P{f  MriG  }  =  P,  { f )  =  [  f.  P  „  {  f }  +  P{|)  =t  .t  -  M'-P.  ’  fll/plD  =t»  on 
t  ]  0  t  1  t 


(3.15) 


(3.16) 


Equality  (3.16),  which  is  true  for  each  f,  shows  Pp  =  P^ ,  which  contradicts  the 
assumption  that  M  is  the  set  of  the  third  type. 

(5.  IT)  COROLLARY.  P^Oci^}  =  1. 

.  By  proposition  (5.15)  the  sets  { =  t )  and  {t e  M)  are  indistinguish¬ 
able.  Using  (3.4), 

P(l)t  =  t)  =  P(1»  =  t,  Of  M1}  =  P(n  =  t)P  (0  c  (2p) . 

Thus,  the  statement  follows  from  (3.12). 


12 


w 


(3. 18)  PROPOSITION.  For  any  functions  f  e  b6°  and  g  e  bG°+  such  that  g  =  0  on_ 
{d^  =  ®}  and  each  i  =  0.  1 


Pi{foTd  *}s  Pi{g5dt>t}P0{f}  +  pitfi;dt=t}p1{£}- 


(3.19) 


For  i =  1.  Put  T  =  t  +  s.  By  (3.4)  and  (3.12) 


P  {f°T,  g}  =  P  { f  ^  MT  g  0  MS  |  n  =  s  }/P{  D  =  s } , 
1  dt  s  s 


Taking  first  conditional  expectation  with  respect  to  G. 


Pjtf'Tj  g)  =  P{goMSi<t+s(Dt  +  s)P0{f}  +  goMSlt+s(Ut+s)P1{f}|Ds  =  s}/p{Ds  =  s} 


which  is  equivalent  to  (3.19). 


Let  . 


n  -  inf{s  >  t:  see0}, 


A  - 

nt  =  nt  ° M, 


y  =  inf  (s  >  nt :  sew0), 

vt  =  in  f  {s  >  9^ ,  sc  } , 

_  A  ~  ~  A  -  -  A  ~ 

n  =  n0,  y  =  Y{),  v  =  vQ, 


A  ~  U 

Yt  =  Y  <•'  M  , 


L- J  mj  >  l 

\  =  vt  «  M, 


(3.20) 


!|  r|n»  T  -  • 


(.3. 21.)  PROPOSITION.  For  y  and  r,  defined  by  (3.20) 


iy?i  =  0 }  =  1  . 


(3.22) 


.ind  there  exists  a  constant  0  ■  such  that  for  each  a 


P^Y  >  3}  =  c 


(5.25) 


'./■ /V 
*-• 


'.-v*  .?.:«• 


.  • .  > .  • . 


-’y  -  ”, 


•V 


?xcq {j.  (3.22)  follows  from  (3.17).  Let  a,  b  >  0.  Applying  Proposition  (3.18) 


P.  {y>a+b}=P.  {Y>a,-yox  >b}=P.  (y>a,d  =a)P.  {-Y>b}  +  P.  {y>a,d  >a}Pn{v>b}  (3.24) 

I  1  3  1  a  1  1  3  U 

If  y  >  a  then  a  e  i3°  and  d  =  a.  Thus  P1(Y>a,  d  >  a)  =  0  and  (3.24)  equals  to 
P^Y  >  a)  P^(Y>b}  whereas  (5.23)  follows. 

Suppose  (3.23)  equals  1.  Then  Pj{lR+  c  w°}=  1.  The  latter  would  imply  that 

M  is  a  mixture  of  a  real  line  1R  and  a  regenerative  set  with  the  law  of  regenera¬ 
tion  P  .  This  contradicts  the  assumption  that  M  is  a  set  of  the  third  type.  Like 

wise,  if  (5.25)  equals  0,  then  this  would  imply  that  P{da=a}  =  0.  The  latter  is 

with  a  contradiction  to  (3.12). 

Let  n  ,  Yt>  •••  etc.  be  given  by  (3.20).  Define 

h(0,t)  =  Y(0,t)  =  v(0,t)  =  t  ,  (5.25) 

n(k,t)  =  » 

Y(k,t)  =  Y-(k_1>t)  » 

v(k,t)  =  k=  1»  2>  ••• 

n(k,t)  =  h(k,t)  o  m 
Y (k , t)  £  Y(k,t)  o  M 
v(k,t)  =  v(k,t)  ° M. 

When  t  is  fixed  we  will  write  for  brevity  h(k) ,  y(k),  y(k),  etc.  instead  of 
n(k,t) ,  y (k , t) ,  y (k , t) ,  etc. 

The  points  n(k)  and  y(k)  mark  the  beginnings  and  the  ends  of  the  intervals 
which  Mn[t,“[  is  composed  of. 


(3.20)  PROPOSITION. 


The  sequence  {(y(k)  -  n(k) , 


v(k)  -  y (k)  ,  n(k  +  l)  -  y  (k) )  )  is  a 
F,P),  The  sequences  W(k)  -  n(k)  ) 


and  v(k)  -  y(k)}  are  independent  and  for  any  a  >  0 


P(y(k)  -  n(k)  >  a)  =  e~  * 


(3.27) 


where  A  is  the  same  as  in  Proposition  (3.21). 

The  sequence  { (y(k)  -  h(k) ,  v(k)  -  y(k) ,  n(k+l)  -  v(k)) }  is  a  sequence  of  iid 
three-dimensional  vectors  on  (fi°,G°,P^) ,  i  =  0,  1.  The  sequences  (y(k)  -  n(k) }  and 
(v(k)  -  y  (k) }  are  independent  and  for  any  a>0  and  anv  i  =  0,1 

Pi(y(k)  -  n(k)  >  a]  =  e"Aa  . 

^  follows  from  [2]  Ch.  VI  that  for  each  k  the  random  variables 
n(k),  y(k)  and  v(k)  are  stopping  times  and  if  k  < j  then 

v(j)  <  n(k)<y (k)  <  v(k) . 

Let  h  be  any  bounded  function  of  three  variables.  Since  n(k)  e  M,  using  Proposition 
(3.5), 

P{h(y(k)-n(k)  ,v(k)-y(k) ,  n(k+l) -v(k) )  |  G^j.^)  =  PjOi(y,v-y,n(2 ,0)-v) }  . 

The  above  shows  independence  of  (y(k)  -  n(k) ,  v(k)  -  y(k) ,  n(k+l)  -  v(k))  from  the 
sequence  (y(i)  -  n(j),v(j)  —  y(j),  n(j  +  l)-v(j))},  j  =  i>  2 ,  ...,  k-1. 

Let  g  be  a  bounded  function  of  one  variable.  Put  f(w°)  =  g(v-  y)  •  Then  using 
Proposition  (5.5) 

P{g(v(k)  -  y (k) )  l>b  (y (k)  -  n(k) ) }  (3.28) 

-  Pil>b(y(k)-n(k))f.Tn(k>b.M) 

=  Hl>b(v(k)  -  n(k)))Pj{f)  . 

The  last  equality  in  (3.28)  is  due  to 

{ Y  ( k )  -  n(k)  >  b}  c  (n(k)  +br  Al . 

and  (3  4).  Likewise,  setting  h(w°)  =  k^v) 

P{y  (k)  -  n(k)  >  b}  =  POiot^^  oM)  =  p^h)  =  P}{y  >  b) 
and  (3.27)  follows  from  (3.23). 


The  proof  of  the  second  part  of  the  proposition  is  done  in  a  similar  manner 


4.  Deletion  Operation  and  its  Properties. 


In  this  section  we  define  an  operator  which  removes  parts  of  the  set  M  in 
such  a  way  that  M  becomes  a  regenerative  set.  Put 


K(w°)  =  u)°\closure (<2°)  =  limu'°\  u  [n(k,t),  Y(k,t)] 


t-*~“  k=l 


K(u>°)  =  K( u>°)  . 


(4.1) 


The  operator  K  removes  closure  of  the  interior  of  u>° ,  and  the  remaining 
set  has  no  interior.  Thus 


K0>)  =  0  . 


(4.2)  PROPOSITION.  For  anv  w°  and  any  t 


d^  o  K(u°)  e  u>° 


(4.3) 


P-toe^.  Suppose  (4.3)  is  wrong,  then  for  some  k^l 


dt°K(tu°)  c  Ch(k,t) ,  Y (k ,t)  [ 


(4.4) 


Since  ■  K (.■.')  •  k(i.'~)1  the  only  way  that  (4.4)  can  be  true  is 

dt  °  K(u>°)  =  h(k,t)  .  (4.5) 

If  ~>(k,t)  =  t  then  (4.5)  fails  because  in  this  case 

dt  -  Kfo." )  -•  7(k,t)  -r.(k,t).  If  t'"n(k,t)  then  (4.5)  implies  ]t.,h(k  ,t)  [e  ), 
Thus  n(k,t)-  k(i..''1)  which  contradicts  (4.5). 

(4.6)  THEOREM .  The  set  k  °  M  is  a  stationary  regenerative  set. 

From  a  trivial  relation 

=  u°+s 
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it  follows  that 


K  o  M  +  s  =  K(M  +  s).  (4.7) 

Likewise 

=  K«t  »H  .  (4.8) 

Relation  (4.7)  shows  that  stationarity  of  M  implies  stationarity  of  K»H. 

Put  s  dt  °  K  »  H.  Then  is  a  stopping  time.  By  virtue  of  Proposition 
(3.5),  Proposition  (4.2)  and  (4.8),  for  any  function  f e  bG° 


P(f  °  td  ,  °  K o  M|GD,+)S  pQ{f  o  K 


Dt 


"l'GDp>  * 


P0(f 


K} 


(4.9) 


This  proves  that  K»H  is  regenerative  with  the  law  of  regeneration 

P  =  PQ  o  K"1  .  (4.10) 

(4.11)  REMARK,  The  proof  of  Theorem  (4.6)  shows  that  K°M  is  regenerative 
with  respect  to  the  filtration  G'  =  GD,+  which  is  larger  than  the  natural 

z  ut 

filtration  generated  by  K  o  m#  it  can  be  shown  in  a  similar  manner  that 


p0(foTdt°K|Gdt*i  ■  -  Pit)  . 


(4.12) 


We  will  call  K«H  the  regenerative  part  of  the  set  M.  By  [6]  the  set 
K  °  M  is  cither  perfect  or  discrete. 

According  to  [7]  and  [11]  their  exists  a  process  zQ  with  independent  incre¬ 


ments  such  that  K(u°)  =  for  Pq  a. a.  w°  and  such  that  the  local  time 

+ 


0  =  z~*  =  inf{t:  z  &  s} 

s  s  t 


(4.15) 


is  a  continuous  process  adapted  to  the  o-field  G^  +  and  for  any  ue  z^ 


0  =  0  +  0  o  T 

u+s  u  s  u 


(4.14) 


(4.15)  PROPOSITION.  I_f  M  is  a  stationary  Markov  set  with  a  perfect  regenera¬ 
tive  part  then 

P0  (0£  <2°)  =  0  . 
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Vnoo ($.  Put 


Then  is  a  sequence  of  stopping  times  such  that 

T  =  D_  =0  on  {0  e  w0}  .  (4.16) 

n  1 

n 

From  [6]  and  [8]  it  follows  that  for  any  perfect  regenerative  set  with  the 
law  of  regeneration  P 

P{0  is  an  isolated  point  in  to0}  =  0  .  (4.17) 

On  the  other  hand  K(w°)  and  u°  coincide  in  a  neighborhood  of  0  on  (0e  ui0}. 
From  (4.10)  and  (4.17)  follows 

PplOeu0,  0  is  isloated  point  in  w0}  =  0  .  (4.18) 

Combining  (4.18)  with  (4.16)  we  get 

d^,  4-0  a.s.  Pq  •  (4.19) 

n 

Take  f=g(r  ,r  ,...,r  ),  where  g  is  a  positive  bounded  continuous 

S1  s2  Sk 

function  of  k  variables.  By  virtue  of  (4.19) 

Pn(f)  =  lim  Pn(f  0  t  ,  }  =  lim(lT  (u>°)  P.{f)  +  1T  --0  Pn ( f )  (4.20) 

0  n  0  dT  n  Tn  1  Tneu  0 

n 

Suppose  P^lOrid0}  =  z  >  0.  Then  the  right  hand  side  of  (4.20)  converges  to 

ePjtf)  ♦  ( 1- e) PQ( f } 
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which  implies  pq =  P1  ‘  The  latter  implies  M  is  a  regenerative  set,  and  this 
is  in  contradiction  with  our  assumption  that  M  is  the  set  of  the  third  type. 

Let  b(oj°)  be  the  set  of  accumulation  from  the  left  points  of  w0,  i.e. 
xeb(to°)  iff  there  exists  a  sequence  {x  }  such  that  x  <  x.  x  e  u>°  and  x  +  x. 

(4.21)  PROPOSITION.  Vf  M  has  a  perfect  regenerative  part  then  for  each  k 


and  t 


P(n(k,t)  e  b(M) }  =  1 


(4.22) 


VKOO&.  Suppose  (4.22)  fails.  Then  with  a  positive  probability  there  exists 
an  interval  contiguous  to  M  whose  right  end  coincide  with  n(k,t).  Fubini's 
theorem  implies  an  existance  of  u  for  which 


P(Du  =  n(k,t)  ,  Du>u)  >  0  . 


(4.23) 


Applying  (3.4)  to  f=  1q(<2°)  and  using  (4.23),  we  get 


PQ{0  £(2°)  >  0 


which  is  in  contradiction  with  proposition  (4.21)  . 


C0  °» 

ck  =  6n(k)  =  0y(k)  H  Gv(k)  ’ 

where  0s  is  given  by  (4.15)  and  h(k) ,  y(k)  and  v(k)  stand  for  h(k,0),  y(k,0), 


and  v(k,0),  given  by  (5.5). 


(4.24)  PROPOSITION.  _If  M  has  a  perfect  regenerative  part  then  -  gj,  ^ , 
k  =  1  ,  2,  ...  are  exponential  iid  on  (Q°,  G°,  P^} . 

P'icofi.  Let  h=h(l).  Consider 

PQ  { C  j  >  a  +  b)  =  PQ{0,>a  +  b}  =  P0{6->a,  6-  -  a  >  b>  . 
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(4.26) 


o  =  inf { s :  6  £  a) . 
s 


Then  o  is  a  stopping  time  with  respect  to  and  0o  =  a.  Thus  the  right-hand 

side  of  (4.25)  can  be  written  as 


Pn{0.  >a,  0~  -  0  >  b)  =  Pri{0->a,  0~  °  t  >  b 

0  n  *  n  o  On  n-o  o 


} 


(4.27) 


Pn{0. >  a,  0-  _  o  T  >  b) 

0  n  "" 


n°T0  a 


Pn^Pn^e~  0  >  b i G°  };  0, >  a} 

0  0  n°T0  0  '  o+  ’  n 


Pn{0- >  a}  Pn{0- >  b}  . 
On  On 


The  first  equality  in  (4.27)  is  due  to  (4.14).  The  second  equality  holds  because 


a>h  and  for  any  s  heis  =  h-s  on  the  set  { s  <  n }  .  The  last  equality  in 


(4.27)  is  a  consequence  of  Proposition  (3.10)  and  the  equality 


d  =o 
a 


which  is  true  for  any  perfect  regenerative  set  and  any  o  given  by  (4.26). 
Equally  (4.27)  shows  that  has  exponential  distribution. 


Since  for  anv  k 


]n(k) ,  v(k)  [  c  K  °  u°. 


the  quantities  0..^)  and  ^v(k)  coincide. 

in  which  (4.27)  was  obtained, 

Thus,  in  a  way 

P.{0_n  ...  -  0.n  ,  >  a 

0  n(k+l)  n(k) 

1  <$,„,♦> 

=  Pn{0_,.  -  0_ri  s  >  a 

0  n(h+l)  v(k) 

1 

=  P0{9n(k+l)-v(k)  °  Tv(k) 

>  a  1  G°  .  } 

1  v(k)+J 

=  P„{0-  0  t-,,  >  a 

0  n°T-.r,.,  v(k) 

v  (K ) 

l  eSw» 

=  Pn { 9- >  a) 


The  above  equality  shows  that  ^  is  independent  of  ?n  -  cn  j,  n =  1,  2,  fc 

and  have  the  same  distribution  as 

(4.28)  REMARK.  The  proof  of  Proposition  (4.24)  also  shows  that  ]  is  indepen 

dent  of  the  sequence  of  random  vectors  (v(n)  -y(n),  y(n)  -  h(n)),  n  =  1,  2,  ...  . 


5.  Structure  of  Stationary  Markov  Set. 

In  this  section  we  will  show  that  each  stationary  set  M  is  ( JI ,  a , \ , u) - 
generated.  This  will  be  done  separately  for  the  case  in  which  M  has  a  perfect 
regenerative  part  and  in  the  case  in  which  M  has  a  discreet  regenerative  part. 

Suppose  M  is  a  set  with  a  perfect  regenerative  part  and  is  its 

law  of  regeneration.  Consider  the  process  on  (ft°,G°,Pg) 

V  =1  (v(k)-n(k)), 

k:£,  <t 


where  ^ =  0h(k)  w^t^1  6  given  by  (4.13).  The  process  Vt  is  of  a  pure  jump  type, 

In  view  of  Proposition  (4.24)  ^  ^  are  exponential  iid.  By  virtue  of  the 

proposition  (5.26)  and  Remark  (4.28)  the  random  variables  (v(k)  -  n(k))  are  iid 
independent  of  the  point  process  Therefore,  the  process  V  is  a  process 

with  independent  increments. 

Proposition  (4.21)  and  Proposition  (3.10)  together  with  (4.18)  show  that 
n(k)  and  v(k)  are  points  of  accumulation  of  K ° u0  a.s.  Pq.  This  implies 


?-r  =  v(k) ,  z  =  n(k) , 

4k  V 


(5.1) 


where  z^  is  the  process  whose  image  is  equal  to  K  °  w°  n  [0,°°[.  Prom  (5.1) 


and  the  definition  of  V  follows 


Put 


wt  =  zt  -  vt  • 


Since  both  z  and  V  are  processes  with  independent  increments,  so  is  W  . 

L  t  v 

The  set  K  °  co°  has  Lebesgue  measure  zero,  therefore  the  process  z^  has  trans¬ 
lation  constant  equal  to  zero  and  is  of  a  pure  jump  type.  In  view  of  (5.2), 

H't  is  an  increasing  process  of  a  pure  jump  type  such  that 


W  =  K 

V 


(5.3) 


Relation  (5.3)  implies  that  Vc  and  have  no  common  points  of  discon¬ 

tinuity.  Accordingly  V  and  W#  are  independent  (see  [10]). 

(5.4)  THEOREM.  A  stationary  Markov  set  M  with  a  perfect  regenerative  part  is 
( JI ,  a  ,  X  ,  c)  -generated. 

PXOO&.  For  each  t  we  need  to  find  <j>t  such  that  M  n  [4>t ,°°[  is  a 
(It, a  ,X,y)-set.  In  view  of  stationarity  it  is  sufficient  to  consider  only  t  =  0. 
Put  4  =  v ,  where  v  is  given  by  (3.20).  Let 

X.  =  y(k)  o  i  o  m  -  h(k)  °  t  o  M  =  y(k+l  ,0)  -  n(k+l  ,0)  , 

K  V  V 


Y,  £‘v(k)°i  °  M  -  y  (k)  °  x  °M  =  v  (k+1 ,0)  -  y  (k  +  1 ,0)  , 

K  V  V 


xt  =  vt  °  TV  +  ^ 


=  U’  OX  + 
'  t  t  V 


(5.5) 


Then  for  2  given  by  (2.6)  we  have 


Z  =  z  °  x  o  M  + 
t  t  v 


°k  =  S  °  Tv  °  M 


Let  H  he  the  Levi's  measure  of  the  subordinator  W.  Let  a  be  the  parameter 
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of  the  exponential  distribution  of  *  be  the  parameter  of  the  exponen¬ 

tial  distribution  of  yOO  -  n(k)  (see  (3.27))  and 

U(D  =  P{ v (k)  -  Y00  e  D  =  PQ{v(k)  -  y(k)  e  T] . 

Wc  would  like  to  show  that  the  set  M  n  [ 4> ,°°[  is  a  ( JI ,  A  ,a,  p) -set  as  defined  by 
(2.6)  -  (2.8).  Since  v =  and  y  l  M,  we  can  apply  Proposition  (3.5)  and  get 

P{f°MY|G  )  =  P(f°T  °  Mj  G  }  =  Pn{f}  .  (5.6) 

'  y+  v  Y+  U  J 

In  particular,  (5.6)  shows  that  the  law  of  (V,  °  ty  °  M,  K,  °  tv  °  M)  is  the  same 

as  the  law  of  (Yo,  IV.)  on  (fi°,G°).  It  also  shows  independence  of  v  and 

(Y.  °  -  °  M,  IV.  o  t  °  M)  . 
v  v 

A 

For  M,  =  t  o  m  and  for  =  V  +  h’ 

1  v  t  t  t 


Thus 


M1  = 


'IR 


°  M, 


ZJR°M1  +  *** 


K  o  M  n  [  4> ,  °°[ 


The  construction  of  the  process  Vt  (and  xt  by  (5.5))  shows  that  L  given  by 
(2.7)  coincides  with  the  closure  of  Ni  n  [<t> ,®[ .  Since  M  =  K  »  HuM,  we  got  the 
representation  (2.8)  with  x.  and  y.  given  by  (5.5).  Proposition  (4.24)  shows  that 
Cj.  =  Cj.  0  i  _  0  M  forms  a  Poisson  point  process.  Proposition  (3.26)  and  Remark  (4.28) 
show  the  required  independence  of  (X^),  (Yj.)  and  y.  as  well  as  independence  of 
x.  and  y„  given  by  (5.5).  This  concludes  the  proof  that  Mn  C , °°r  is  a 
(II ,  a  ,  A ,  p)  -set . 

A  stationary  Markov  set  with  a  discreet  regenerative  part  cannot  be  treated 


in  the  same  manner  because  Propositions  (4.15)  and  (4.21)  are  no  longer  true  in 
this  case.  As  a  result  (5.1)  and  (5.2)  as  well  as  (5.3)  might  fail.  The  failure 
of  (5.1)  -  (5.3)  might  result  in  dependence  of  the  processes  V.  and  W.  . 


However,  the  case  of  a  set  with  a  discreet  regenerative  part  can  be  treated 
"from  scratch".  The  analysis  of  this  case  is  rather  simple,  so  we  will  only  out¬ 
line  the  main  points  without  going  into  details. 

Put 


p  =  Pq{0  e  (2°)  . 

(5.7) 

It  is  easy 

to  show  that  if 

M  has  a  discreet  regenerative  part  then 

0  <  p  <  1 . 

Let  X  be 

given  by  (3.23) 

and 

y(r)  =  Pq{v  -  y  e  r) 

(5.8) 

n(r)  =  PQ{d0e  r I 0 e  U>° } 

(5.9) 

Proposition  (3.5)  shows  that  the  right  endpoint  of  each  interval  contiguous 
to  M  belongs  to  M  with  probability  p  independently  of  the  length  of  this 
interval.  Thus  °  M  can  be  described  by  means  of  a  Markov  renewal  process 
U (t)  (see  [1]  Chapter  10)  with  three  states.  The  holding  time  in  the  first  state 
is  exponential  with  parameter  A,  the  holding  time  in  the  second  and  third  states 
have  distribution  y  and  JT  respectively.  The  transition  matrix  of  the  imbedded 
discreet  Markov  chain  is 

0  1  o' 

p  0  1-p 
p  0  1-p 

The  set  of  times  when  U(t)  undergoes  transitions  from  one  state  to  another  or 
U(t)  is  in  the  first  state  corresponds  to  °  M. 

It  is  easy  to  verify  that  the  set  Hn[v,»[  =  v  +  t  <>  M  is  a  (JT  ,a,  A ,  y) -set 
where  a  is  such  that 

a 

^  ”  a+1 

(Note  that  if  is  a  (0, II)-proccss  and  x^  is  the  process  defined  by  (2.6), 

then  a/  (a+1)  =  P(o^<inf{t:  y  *  y^  })). 
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(5.9)  PROPOSITION.  _If  M  is  a  stationary  (n ,  a, A t  y) -generated  set  then  17  and 
v  satisfy  (2.13),  (2.14). 

Pnoo&.  (For  M  with  a  perfect  regenerative  part,  for  M  with  a  discreet 
regenerative  part  the  proof  is  similar).  Let  xt  and  y  be  the  subordinators 

which  generate  (IT  ,  a, A,y)-set  (see  (2 . 6) - (2. 8) ) .  Then 

K  o  (Z^  u  L)  =  . 

+  ♦ 

The  latter  shows  that  the  process  Z  =  x+y  generates  stationary  regenerative  set 
K °  M.  If  IT'  is  the  Levi's  measure  of  Z  then  from  [8]  and  [11] 

CO 

/  x  n»  (dx)  <  -  .  (5.10) 

0 

On  the  other  hand  it  is  known  (see  [10])  that 

00 

P{Z  -  Z  }  =  t  /x  n  •  (dx)  (5.11) 

u  0 

The  left  hand  side  of  (5.11)  can  be  rewritten  as 

00  co 

p{y  -y  }  +  P(x  -x  }  =  t/x  n(dx)  +  t  a-1  [A-1  +  /xy(dx)]  (5.12) 

0  0 

Relations  (5.10),  (5.11)  (5.12)  imply  (2.15)  and  (2.14). 

(5.15)  PROPOSITION.  _If  M  is  a  (JT  , a  ,  A  ,  y) -generated  set,  then  the  quadruple 
( IT  ,  a ,  >  , u )  is  determined  by  M  uniquely  up  to  equivalency . 


P-IOOfi.  T!ie  compliment  of  M  consists  of  a  union  of  open  intervals  (L^.  ,  R^)  . 
Since  Mn[<j  ,«[  is  a  ( It , a  ,  A , y) -set  we  can  write  (recalling  representation  (2.6) 


(2.5)). 


P{  m  } 
v(l)<t<n(2)  t  t 


(5.14) 


=  lim  1  )  lu  *.  } 

k-*»  v(k)<t<n(k+l)  r  \  Lt 


s 


-t t- 


k  k+1 


Q{  J  f(yt->V)1y  *v  1 

Vt<0k+i  yt't- 


n  {f  }Q{ak+1  -  ak)  =  a  JT{f) 


Here  Q  is  the  probability  measure  associated  with  the  process  x,  y  and  Z  in 
(2.6)  -  (2.8).  Formula  (5.14)  shows  that  (IT,  a)  is  determined  by  M  uniquely  up 
to  proportionality. 

On  the  other  hand,  direct  computations  show  that  for  any  (IT ,  a, A, a)  -set 


P{y-n)  =  [A(l-a  p{0)  /  (ct+  II(fo+))]‘ 


(5.15) 


P{v-y  e  r)  = 


p(T)  if  n(]R  )  =  •» 


(5.16) 


vi'(r)  +  p{o)  n(R+)"!  Ji(r),  if  n(R+)<» 


Equalities  (5.15)  and  (5.16)  complete  the  proof  of  the  proposition. 


6.  Markov  Properties  of  the  Residual  Life  Process 


Consider  the  "residual  life"  process 


Rt  =  inf{s  -  t :  s  >  t ,  s  e  M) 


(6.1) 


associated  with  the  stationary  Markov  set  M.  Markov  property  of  M  implies  that 
Rt  is  a  Markov  (but  not  necessarily  a  strong  Markov)  process. 

Consider  a  ( IT ,  a , X ,y) -set  given  by  (2.7),  (2.8)  and  the  processes  y.,  x.  and 


Z.  which  generate  it.  Let 


c  =  infis  £  0:  Z  £  a)  % 


(6.2) 


Let  M  be  the  union  of  o,  (see  (2.6)).  Then  R 

K  t 

represented  as 

0  if  e  W  and  t  e  y  , 

F  -  t  otherwise  . 


given  by  (6.1)  can  be 


(6.4) 


Let  Q  be  the  law  of  the  subordinators  x.  and  y.  of  (2.6)  -  (2.8).  The 
transition  function  of  R  associated  with  a  stationary  (II ,  a  ,  A,  p) -generated  set 
is  the  same  as  transition  function  of  Rt  associated  with  any  (II  ,ct ,  A, p) -set . 
Hence  we  can  assume  any  distribution  of  y^  in  (2.6)  -  (2.8),  in  particular 

Q(y0  =  o}  . 

The  transition  function  of  the  process  R^  given  by  (6.4)  is 


p(t  ,x;  f)  =  lr(x)  if  x  <t, 


p(t,x;r)  =  Q{F  -ter.ceN)  +  J  Q{F  -teT.c  =a.  ,Z  +X<t},  x  >  0,  OeT, 

L  t  k“  1  ^  L  K  —  K 


p  ( t ,  x ;  { 0 } )  =  l  Q(c  =o,  ,2  +  X,  >t) ,  x>0, 

k=l  t  K  Ok-  k 


(6.5) 


'(t ,0; r)  =  e  Xtl  . ( r }  +  /Ac  Ayp(r  +  t  -  V  ) dy  +  /  p  (dv)p(t-y ,y ; r)  , 

0  0 


t  .  t 

-*y. 


where  p  is  a  distribution  of  the  jumps  of  the  process  x.  (i.e.,  p^  is  a  con¬ 
volution  of  and  an  exponential  distribution  with  parameter  X). 


A  (IT,  x,  >,;) -generated  set  is  stationary  iff 

mt(n  =  P(Rt  e  D 


does  not  depend  on  t 


Inversely,  if  we  are  able  to  construct  a  probability  measure  m  which  is 


invariant  with  respect  to  p(t,x;T)  then  the  stationary  Markov  process  R^  with 
the  one  dimensional  distribution  m  and  the  transition  function  p  will  yield  a 
stationary  (It ,  a.  A, p) -generated  set  by  the  formula 


M  = 


where  =  t  +  . 

(6.6)  THEOREM.  _I_f  II  and  A  are  subject  to  (2.13),  (2.14)  then  there  exists  a 
unique  stationary  probability  measure  m  for  the  Markov  process  R^  associated 
with  a  (IT,  a, A, u) -set.  The  measure  m  is  given  by 

OO  oo 

m(f)  =  C[A_1f(0)  +  /f(t)uQt,“[)dt  +  a-1  /  f(t)IT  (  ]t,°°[)dt]  . 

0  0 


For  the  proof  of  this  theorem  we  need  the  following  proposition. 


(6.7)  PROPOSITION.  Let  (y^.Q)  be  a  (0 . II) -process  and  let 


c  -  =  inf(s :y  £  a) , 
a  '  s 


Let  S  be  an  exponential  random  variable  with  parameter  a  independent  of  the 
process  v  .  Then 

>S  i  °° 

r  —  (o.8) 


Ql  /  f(v  -u) du)  =  a.  /  f(t)  n(]t,«[)dt  . 

0 


0  cu 


P'iCO j .  The  right-hand  side  of  (6.8)  can  be  rewritten  as 


Q (  I  /  f(y  -u)du} 


v  *v  ,  s'  S  v 
' S  ' S- *  ' s- 


=  Q{  l  /  f(u)du) 


y  *>'  s^S 
-'s's-,  y 


s- 


-Wl  'S!S  "VV”  ' 


y  *y 

s  s- 


(6.9) 


where  g(t)  =  /  f(u)du.  The  right  hand  side  of  (6.9)  is  equal  to 
0 


Q{JI(g)S  }  =  JI(g)  Q { S }  =  a'  JI(g) 


(see  [10]  Section  3).  By  Fibini's  theorem 


oo  oo 


n(g)  =  /  g(x)  n(dx]  =  /(/  f(t)dt)  it(dx)  =  /  f(t)  / n(dx)  =  /  f(t)  n(]t,«[)dt 

o  oo  o  t  o 

whereas  (6.8)  follows. 

Ptee $  of  the  Theorem  (6.6).  Let  x.  and  y.  be  the  processes  (with  Q{v  =0}=1) 
which  generate  a  (JT  ,  a  ,  X,y) -set  by  formulae  (2.6)  -  (2.8).  Then  the  process 
associated  with  this  set  by  formula  (6.4)  is  a  regenerative  process  (see  [1]  Ch.  9) 
with  the  moments  of  regeneration  p^,  p^,  ...»  Pk>  ••• 


Pl-  = 

k  ok 


Really,  by  virtue  of  the  strong  Markov  property 


k  A 

X  =  X  -  X 

s  ok+s  ok 


y  =  y  -  y 
s  ok+s  ok 


have  the  same  distribution  as  the  processes  x  and  y?  respectively  and  are 
independent  of  {xs>  ys;  sSOj.}.  Since 

\*t  ■  Rt"  (>=••>'•) 

the  process  R  is  independent  of  (Rs>  and  has  the  same  distribution 

k 

as  R  .  The  same  argument  shows  that  the  sequence  ( p k }  forms  a  renewal  process. 
Since 


rk+l  '  Pk  =  “ok  +  1  '  ~ok 


=  ( v  -  y  )  +  x,  +  x , 

'  o,  ,  °i  k  k 

k+1  k 


and  since  Xk  has  a  continuous  (exponential)  distribution,  Pk+j  Pp  'ias  3 
continuous  distribution  as  well.  Thus  the  renewal  process  {p,}  is  aperiodic  and 


E{pk+i-Pk}  =  E(Xk}  +  E(Yk}  ♦  E{yo 


(6.10) 


k+1 


} 


=  X  *  +  /  t  M(dt)  +  ct~*  /  t  II (dt)  . 
0  0 


The  right-hand  side  of  (6.10)  is  finite  by  virtue  of  (2.13)  and  (2.14). 

According  to  Theorem  (2.25)  of  Chapter  9  of  [  1  ]  there  exists  a  unique  sta¬ 
tionary  measure  m  for  the  regenerative  process  R. ,  given  by 

P1 

m(r)  =  c  Q{  /  1 „ ( R  ) dt } ,  (6.11) 

0  1  P 


where  C  is  equal  to  (6.10)  (The  expression  in  (6.11)  is  equivalent  to  the  one 
given  in  Ch.  9,  Theorem  (2.25)  of  [1]).  Since  the  process  x^  is  equal  to  0  on 
the  interval  30, Ojf  the  process  Zg  coincides  with  y^  on  and 


=  y  -  t  for  t  <  y 
t  c,  J  l 


R.  =  0  for  y  <  t  <  y  +  X. 
t  -v0l  \  1 


R.  =  Z  -  t  -  y  +  X.  +  Y.  -  t  for  y  +  X,  <  t  ^  Z 

t  Oj  •«,  11  1 


(see  (2.6),  (2.8)  and  (6.4)).  Thus 


v 

*  o, 


•vi 


i  “i  "i 

Q{  /  1 „ (R  ) dt >  =  Q{  /  1  (y  -t ) dt }  +  Q {  /  1  (0) dt }  ♦  Q {  /  lr(Y  -t)dt  i  (6.12) 

0  !  0  1  ‘‘t  0  0 

The  first  term  in  t he  right-hand  side  of  (6.12)  equals  to 

or 

a-1  /  1  (t)  n(]t,~])dt  (6.15) 


by  virtue  of  Proposition  (o.7).  The  second  term  in  (6.12)  equals 


lr(0)  E  (Xx }  =  1 r ( 0) X 


-1 


(6.14) 
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The  last  term  in  (6.12)  equals 

(6.15) 

Y  Y  oo  oo 

Q{  r1l„(Y1-t)dt)  =  Q{  J 1  1 _ (t ) dt }  =  Q {/  1  (t) 1  dt }  =  /  1  (t)w(]t,-[)dt  . 
b  ‘  1  0  1  0  1  o 


From  (6.11)  -  (6.15)  follows  Theorem  (6.6). 

(6.16)  COROLLARY.  For  each  (II ,  a,  A,  a)  subject  to  (2.13),  (2.14)  there  exists  a 
st  at  i  on  a  rv  ( TT  ,  a ,  A ,  u ) -generated  set. 

This  completes  the  proof  of  the  Theorem  (2.12). 


(6.17)  REMARK.  The  proof  of  Theorem  (6.6)  shows  that  any  (J1  ,  a,  A , a) -generated 
set  M  with 

P{inf  M  =  -°°}  =  1 


is  stationary. 


7.  Revcrsabi lity  Properties  of  Stationary  Markov  Sets. 

In  this  section  we  will  prove  Theorem  (2.15).  Ke  consider  a  stationary 
(IT,  50) -generated  set  with  a  perfect  regenerative  part.  The  proof  of  Theorem 
(2.15)  for  M  with  a  discrete  regenerative  part  is  similar.  The  closure  of  M 
consists  of  a  union  of  closed  intervals  of  iid  exponential  length  and  by  virtue  of 
Proposition  (4.15)  and  (4.21)  the  endpoints  of  these  intervals  arc  points  of  accumu 
lation  of  M *  M.  Therefore  the  endpoints  of  these  intervals  belong  to  K  °  M. 

According  to  Theorem  (4.6)  the  set  K°M  is  stationary  regenerative  with 
l.ebcsgue  measure  zero.  By  Theorem  1  of  [11]  there  exists  a  (0 , 11 1 )  -  subordinator 
whose  range  coincides  with  K  °  M  r.  [0,°°[.  If  a  =  <5q  ,  then  (2.6)  -  (2.8)  show  that 
JT  *  is  the  I.cvi’s  measure  of  the  process  Z  and 

JT’  =  n  ♦  aGA  ,  (7. 1) 


where  G.  is  an  exponential  distribution  with  parameter  X.  In  particular,  M  has 


a  perfect  regenerative  part  iff 

IT  ( IR  )  =  00  . 

To  show  that  -M  has  the  same  distribution  as  M  we  have  to  consider  the 
two  dimensional  process 

at.Rt)  =  (Vrt)  °  M  • 

It  follows  from  the  Markov  property  of  M  that  the  process  CLt>Rt)  is  a 
stationary  Markov  process.  If  M  is  a  (IT  ,  a , A, 6^) -generated  set  then  the  transi¬ 
tion  function  of  (Lt,Rt)  is 

p(t ,  (u,v)  ;  r)  =  lr(u,v),  if  v>t,  r  c  ]-®,o]  *  [0,°°  [  , 

p(t,(u,v);D  =  QUHt  v,Ft  v)  e  r,  ct_veM},  v<t,  rc]-°°,0[>]0,<*[ 

(7.2) 

p(t,(u,v);  (0,0))  =  Q{ct_veN)  =  £  Q  {ct_v=ok },  v<t  , 

k 

t 

p(t,(0,0);r)  =  /  Ae~  As  p(t,(0,s),r)  ds,  rc]-.,0>[0,»[  . 

0 


Here  Q  is  the  law  of  the  processes  x g,  y?  and  Zs,  of  (2.6)  -  (2.8),  ct  is 
given  by  (6.2)  and  (H^.F^.)  are  given  by  (6.3). 

Note  that  when  a  =  6q,  the  length  of  each  jump  of  the  process  I.  caused  by 
a  discontinuity  of  x.  is  exponenti a  I ly  distributed  and  the  range  of  each  jump 
belongs  to  the  ( II  ,  A ,u, <5n) -generated  set.  This  results  in  simplifications  in 
(7.2)  as  compared  to  (6.5)  . 

Let  FI  (x;  F)  =  Il(r-x)  where  F-x  =  {y-x;  ycr). 


The  process  ( L^. , R  )  is  stationary- 
proof  of  Theorem  (6,6)  for  (Lt,Rt),  wc 
tion  n  of  this  process  is  given  by 

n(fxA)  =  c[A-1  1(0  0-,(rxA)  ♦  a" 


due  to  stationarity  of  M.  Repeating  the 
can  get  that  the  one-dimensional  distribu- 


/  1S(H  n(x;A)ds],  Tc  ]R_  ,  a  c  ir+  . 

.00 
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V-VO-V 

M  ^  Ml  i  I  fc  h  .Jl  iTmA  at  Jl  mlJI  m.. 


Let  (u,v)  =  (v,u)  and  if  A<=1R  x  ir  then  A  should  be  understood  similarly. 


*  A  *  A 

yt  =  -yt*  Xt  =  -Xt  * 


Z*  =  -Z 

Lt  \  • 


ii*(r)  2  n(-r)  , 

n*(x;  r)  =  it* c r -  x)  =  n(-x;-r)  . 


(7.4) 


Consider  the  set  -M.  The  process 


(L*,R;)  =  (£t,rt)  o  (-M)  =  (-Rt,-Lt) 

is  a  Markov  process  with  the  one-dimensional  distribution  (obtained  by  change 


of  variables  in  (7.3)) 


(7.5) 


co 

n*  ( T*A)  =  C[A_1  1(0  0)  (  (-A)  x  (_T))  +  a'1  /  lg(A)  II*  (s ;  F)  ds  )  ,  fc  ] R_  ,  A  c  ]R+ 


and  the  backward  transition  function 


p*(s,  (u,v)  ;T)  =  p(s,(-v,-u)  ;T  )  ,  T  <=  x  [0,“>[ ,  u<  0  <  v 


(7.6) 


A(r)  =  Q {/  1_(Z Jds)  , 

0  J 
oc 

■'* ( r)  =  q {/  ir(i*)ds}  =  .-.(-D  , 
0 

•V ( r )  =  '.(r-b)  , 


A*(r)  =  :*(r  -  b)  , 


(7.7) 


(7.S)  PROPOSITION.  For  any  function  f  of  two  variables 


Q{  l  f(Zt_,Zt)lt-N}  =  /A(dx)/f(x,y)Jl(x;dy) 


Zt-*Zt 


0  0 


mJCmJC  m  A  mJlMjCa-jClJ*  flJVnJ*.  lJV  1%  JV.  -  ~  f.  m.  r_*  .* 


Q{Z‘*Z*f(Zt-’ZtntiN}  =  /A*(dx)  /f(x,y)  n*(x;dy) 

t-  t  -CO  -  oo 

The  proof  of  this  proposition  is  well  known. 

(7.9)  PROPOSITION.  For  any  two  functions  g  and  h  on  1 

oo  00 

/  g(x)  Jl(x,f)dx  =  /  f(x)  n*(x;g)dx  (7.10) 

—OO  _  oo 

00  00 

/  Ax(f)g(x)dx  =  /  f(x)A*(g)dx  (7.11) 

— AC  — OO 

For  the  proof  of  this  proposition  see  [11]  Lemma  6.4  . 

(7.11)  PROPOSITION.  Measures  n  and  n*  given  by  (7.3)  and  (7.5)  respectively'. 
coincide . 

PKCO&.  The  first  term  in  brackets  in  the  right-hand  side  of  (7.3)  is  equal  to 
the  first  term  in  the  right-hand  side  of  (7.5).  The  integral  term  in  the  right- 
hand  side  of  (7.3)  equals  to  the  corresponding  term  in  (7.5)  by  virtue  of  (7.10). 


(7.12)  PROPOSITION.  For  any  two  sets  r,  A c  ]R_  x 

]  n(du,dv)p(s,(u,v) ;A)  =  /n*(du,dv)p*(s,(u,v) ;T)  (7.13) 

r  a 

P-loofi.  Consider  A  and  r  of  the  form 

A  =  A'  x  A"  ,  A'  <  0,  A"  >  0 

(7.14) 

r  =  r2xr2  r^o,  r2>o 

Put  A^  =  A'  +  s  and  =  A" +  s  and  assume 

r2  <  Aj  (7.15) 


(The  inequality  between  two  subsets  of  the  real  line  means  the  corresponding 
inequality  between  any  two  points  from  the  first  and  the  second  set  respectively.) 


For  v  <  A^  we  can  write 


P(s, (u,v) , A)  =  Q{Hg_v £  A'  +  s  -  v,  Fg_v  £  A"  +  s  -  v,  cg  v e  W} 


=  V-v'V  \-v(V  W 

“t-  t  1  2 


=  /  A(dy)  1  (y)  n(y;A  -v) 

0  l"v 


=  /  A  fdy)  1  (y)  JI(y;A_)  . 


(7. 1C 


We  used  Proposition  (7.8)  in  the  third  equality  in  (7.16)  and  the  identity 
IT  (v  -  v;A2  -  v)  =  JT(y,A9)  in  the  fourth  equality  in  (7.16).  Thus  the  left  hand 
side  of  (7.15)  can  be  written  as 


yj  w  co 

/  1  (S)ds  Jn(sjdv)  1  (v)  /  A  (dy)  1  (y)  IT(y;A9).  (7.17 

—  1  s  2  v  v  Al  2 

Applying  successively  (7.10)  then  (7.11)  and  then  again  (7.10)  to  (7.17)  we  get 
the  following  sequence  of  equalities: 


/  n(du,dv)p(s,  (u,v)  , A)  =  /  n*(v,T1)  1  (v)dv  /  Ay(dy)  1^  (y)n(y;A,) 
7  0  2  v  l 


/n  (y ;  A7)  1 ,  (y)  dy  /  /.’ 


1  -°° 


v ( dv ) 1 r  (v)  n  (vjTj) 


(7.  IS 


/  1,  (x)  Tl'(x;dy)  1.  (y)  /  ;*(dv)l_  (v)  n*(v;r,) 

s  “2  “1  y  l2 


From  (7.5)  and  the  analog  of  (7.16)  for  p*(* (*,*),-)  we  get  that  (7.18) 
equals  to  the  right-hand  side  of  (7.15). 

The  proof  of  (7.13)  for  arbitrary  r  and  A  is  done  in  a  similar  way. 

( 7 . 1 9 J  COROLLARY .  The  probability  law  of  the  set  -M  is  the  same  as  that  of  M. 


In  particular  M  is  left  Markov. 


Pxoofa.  From  proposition  (7.11)  we  see  that  the  processes 
(£t,rt)  °M  and  (£t,rt)  °  (-M)  have  the  same  one  dimensional  distribuitons. 
Proposition  (7.12)  shows  that  these  two  processes  have  the  same  backward  transi¬ 
tion  function.  Therefore,  these  two  processes  have  the  same  law.  The  rest  follows 
from  representation 

M  =  (r  o  M)  ^  . 

In  the  remainder  of  this  section  we  show  why  (IT,  a, jj) -generated  set  is  not 
left  Markov  if  (TT,u,X,u)  is  not  equivalent  to  (II  ^  ,  a  ,  ^  ,  SQ)  . 

If  M  has  a  perfect  regenerative  part  (i.e.,IT(]R+)  =  °°)  then  from  (2.6)  - 
(2.8)  we  see  that  the  distribution  of  v(k)  -  y(k)  is  equal  to  y  .  If  p  ?  o’g 
then  with  positive  probability  v(k)  -  y(k)  >0.  By  Fubini's  theorem  there  exists 
t  such  that 

P{Lt  <  t,  Lt  =  y(k) }  >  0  . 

However,  the  latter  contradicts  to  Proposition  (4.21)  (or,  to  be  precise,  to  the 
analog  of  the  Proposition  (4.21)  for  left  Markov  sets.) 

If  M  has  a  discreet  regenerative  part  (i.e.  TT(1R+)  <  00 )  and  (TI,a,A,y)  is 
not  equivalent  to  ( IT  ,r*  ^  ,  6q)  then 

u  '  ci6o *  c2  n  • 

From  (2.6)  -  (2.8)  we  sec  that  the  distribution  of  the  length  of  the  jumps  of  the 
process  y  is  IT(IR+)_iTt.  The  distribution  of  v(k)  -y(b)  is 

u*  +  (1  -  y { 0 } )  IKF"1)  n  (7.21  ) 

where  u'  is  a  restriction  of  p  on  ]0,°°[.  If  (7.20)  is  true  then  l-.-li  is 
not  equal  to  H(IR+)'1  IT.  Elementary  calculations  show  that  in  this  case  the 
conditional  distribution  of  R^  -  Lt  given  the  event 
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